Graphical user interface for selection of audiovisual programming

ABSTRACT

An improved graphical user interface for displaying and selecting video programs, such as video on demand, includes a video on demand server coupled to a communication medium. A plurality of settop box receivers are coupled to the communication medium for receiving digitized programming in the form of movies and the like from the video on demand server. The settop box includes a central processing unit (CPU) coupled to a memory and other electronic modules. The CPU generates and displays the present invention&#39;s graphical user interface on the subscriber&#39;s television. The graphical user interface is based upon a metaphor in which a world of spaces are organized as part of a studio back lot through which a user may navigate. The back lot includes a Poster wall which presents to the user a series of movie posters representing available selections. When a user touches a Poster on a touch sensitive screen of the television, the CPU generates an animation which displays the Poster coming off of the wall and appearing in the foreground of the screen. If a subscriber selects the Poster to view a feature presentation, the video on demand server downloads the selected video which is displayed on the television. The interface of the present invention further includes Extras which appear in animated form on the interface and move freely between spaces within the studio back lot metaphor. If a user selects an Extra, the Extra is transformed into a movie poster or advertisement. The user may then select the Poster and view the feature presentation.

RELATED APPLICATIONS

The present application is a continuation application of Ser. No.08/206,749, filed Mar. 4, 1994, now U.S. Pat. No. 5,524,195, entitled"Improved Graphical User Interface for Interactive Television and Videoon Demand", which is a continuation-in-part of application Ser. No.08/067,574, filed May 24, 1993, now abandoned, entitled "ImprovedGraphical User Interface with Method and Apparatus for Interfacing toRemote Devices" (hereinafter referred to as the "Parent"), both assignedto the Assignee of the present invention, and are hereby incorporatedfully herein by reference."

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to the field of graphical user interfacesand multi-media display systems. More particularly, the presentinvention relates to a method and apparatus for selecting, viewing, andinteracting with, programs and services from a source provider, such asfor example, a video on demand server and/or an interactive multi-mediasystem.

2. Art Background

The combination of computer technology with television. (TV) andaudiovisual (A/V) systems has fostered the development of multimediainteractive entertainment systems. It is known that users desireinteractive television and multimedia applications for home use. Inparticular, users desire to have maximum system flexibility, whichpermits the user to view any one of a selected number of movies or otheraudiovisual programs on demand from their home audiovisual televisionsystem. Advances in the digitalization and digital compression of data,in conjunction with improved communication transmission media, such asfiber optics, permit high-speed downloading of digitized data from ahead end source provider to a plurality of users. The broad bandwidth offiber optic cables permits interactivity between the user (hereinreferred to at times as a "subscriber"), and a source provider.

A variety of video on demand (VOD) systems have been proposed to permita subscriber to select and view a video program at his convenience. Thesubscriber communicates to a source provider at a head-end, a requestfor a specified video program, such as a movie, at a specified time. Thesource provider then transmits the program to the subscriber in a mannersuch that it may be received during the specified time only, and by thesingle subscriber requesting and paying for it, without reception byother subscribers. (See for example, U.S. Pat. Nos. 5,206,722;4,995,078; and 5,247,347).

One of the most significant challenges in providing interactivetelevision service and video on demand (VOD) capability, is the designof an interface which is easy and fun to use by average consumers.Historically, interactive television and pay-per-view ("PPV") systemswhich have been proposed provide a downloaded television listing ofprograms, video on demand movies, and other options for the user tochoose from and execute. The subscriber, utilizing a remote controldevice in conjunction with a settop box coupled to a cable television,satellite direct broadcast or other communication system, selects adesired movie or program to be viewed. One such system is that disclosedby U.S. Pat. No. 4,706,121 (hereinafter the '121 patent), issued Nov.10, 1987 to Patrick Young. The system disclosed by the '121 patentprovides that a downloaded television listing, including availablemovies for viewing, is displayed on a subscriber's television receiver.The downloaded television listing, information may be viewed by title,category, date, as well as start time. Although the downloaded programinformation is displayed for user selection, the interface provided tothe user is a simple listing of available source material for selection.

In the computer industry, a variety of graphic user interfaces have beendeveloped to facilitate human interaction with computer systems. Manydisplay systems utilize metaphors in the design of the interface as away to maximize human familiarity, and convey information between theuser and computer. (See for example, the systems references in JeffreyJ. Blatt, "A Primer on User Interface Software Patents", (The ComputerLawyer, Vol. 9, No. 4, April 1992.) It is well known that designingaround a familiar metaphor helps reduce human learning time. Research ininterface design using metaphors and man-machine interfaces, may beapplied to multimedia systems, and in particular, to interactivetelevision systems having video on demand capability. The marriage ofvideo and television technology with computer interface technologyprovides users with maximum flexibility in storing, retrieving, andselecting television and other audiovisual programming.

As will be disclosed, the present invention's user interface provides auser friendly mechanism for subscribers to select and view audiovisualprogramming, such as movies and the like, using an intuitive userinterface, which is fun and interesting to use. As will be described,the user interface of the present invention utilizes a metaphor in theform of a motion picture production studio back lot. Various spaces andobjects exist in the metaphor, in both static and animated form, foridentifying available programming and for providing a mechanism for theselection and viewing of a desired program by a subscriber.

SUMMARY OF THE INVENTION

The present invention provides apparatus and methods for presenting animproved graphical user interface for displaying and selecting video ondemand programs, as well as other audiovisual programs and interactiveservices. In one embodiment, a video on demand (VOD) server is coupledto a communication medium which is in turn coupled to a plurality ofsubscribers. A settop box is coupled to the communication medium at eachsubscriber's location, for receiving digitized programming in the formof movies, television signals and other data from the video on demandserver at the head end. The settop box is coupled to a television oraudiovisual entertainment system. The settop box includes a centralprocessing unit (CPU) coupled to a memory and other electronic modulessuch as decoders, decompressors and audiovisual generators. Computerprogramming and data files are stored within the memory and accessibleby the CPU. The CPU generates and displays the present invention'sgraphical user interface on the subscriber's television, and controlsany interactive communication between the user, the video on demandserver, as well as any other head-end provider of audiovisual material.

The graphical interface of the present invention is based upon ametaphor in which a world of Spaces is organized as part of a moviestudio back lot metaphor through which a user may navigate. The back lotmetaphor includes a Poster wall which presents to the user a series ofmovie Posters representing available selections. The Poster wall mayinclude video selections for movies and/or other programming arranged bycategory, viewer preference, "Top 10" listings for the week, or anycombination thereof.

In the presently preferred embodiment, when a user selects a Posterusing a touch sensitive input device, the CPU senses the user'sselection and generates an animation which displays the Poster comingoff the wall and appearing in the foreground of the television screen.Once the Poster has moved to the foreground, additional informationabout the movie or other service is provided to the user by reading thePoster itself. By again touching the touch sensitive input device toselect the image of the Poster, the CPU generates an opening animationincludes the presentation of a video preview. If not selected, thePoster prompts the user to further action by moving in an animatedfashion.

The graphical user interface of the present invention includes a videoviewing space where a preview of the movie is shown. The video viewingspace includes a plurality of control button functions and displayscontrolling, for example, volume, mute, channel and current channelselection, intermission, intermission status, selection of the featurepresentation, and exit. In the present embodiment, an animated cashregister icon is displayed to permit a user to ascertain movie price,select, and thereby "purchase" the desired movie. Touching the inputdevice, or otherwise activating the cash register function, results in a"ring-up" sale animation, and the termination of any currently displayedpreview, along with the initiation of viewing of the featurepresentation. Upon selection of the cash register icon, the video ondemand server downloads the selected video to the settop box for displayon the user's television.

The interface of the present invention further includes Agents referredto as "Extras" which are manifestations of the Agent described in theParent of this application, and are metaphors for category oradvertisements for specific movies. Extras appear in an animated form onthe user interface and move freely between Spaces within the studio backlot metaphor. If the user takes no action towards an Extra, the Extrasimply moves out of the field of view of the user on the interface.However, if a user selects an Extra, the CPU senses the selection of theExtra and initiates an animated sequence in which the Extra introduces aPoster to the user. If a user is interested in viewing the Extra'sadvertised movie, the Poster introduced by the Extra behaves in the samemanner as a Poster which has been selected from the Poster wall. In theevent a user is not interested in viewing the video advertised by theExtra, the user may touch any area on the background of the interfaceand the Poster is dismissed in an animated fashion by the CPU.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a functional block diagram of one possible interactivetelevision/video on demand system utilizing the teachings of presentinvention.

FIG. 2 illustrates a functional information flow diagram for the presentinvention's video on demand server.

FIG. 3 is a functional block diagram of the present invention's settopbox.

FIG. 4 illustrates an overview of the present invention's studio backlot graphic user interface metaphor.

FIG. 5 illustrates the present invention's Poster wall for the displayof available video on demand selections.

FIG. 6 illustrates the user panning feature of the interface of thepresent invention to navigate within the studio back lot metaphor.

FIG. 7 illustrates the Poster wall of the present invention for thedisplay of available video on demand selections.

FIG. 8 illustrates a Poster Agent which is displayed upon a user'sselection of one of the movie selections displayed on the Poster wall.

FIG. 9 illustrates the Poster Agent holding an alarm clock in ananimated sequence in the event a user does not select or dismiss theAgent within a predetermined time.

FIG. 10 illustrates the video viewing space of the user interface of thepresent invention for the display of a movie preview upon the selectionof the Poster Agent illustrated in FIGS. 8 and 9.

FIG. 11 illustrates the video viewing space of the present invention inwhich controls are provided for user operation during the showing of avideo on demand movie, including an intermission control function.

FIG. 12 illustrates the video viewing of the present invention in theevent a user selects the movie intermission control function illustratedin FIG. 11.

FIG. 13 illustrates one example of the present invention's use of"Extras", which upon selection by a user, provide additional informationon other selections available by a user.

FIG. 14 is a map to assist the reader in understanding of theorganization of the flowcharts of FIGS. 14(a) through 14(i).

FIGS. 14(a) and 14(b) illustrate flow charts of the operation of thepresent invention for the selection of a movie displayed on the presentinvention's Poster wall.

FIGS. 14(c), 14(d) and 14(e) are flow charts illustrating the operationof the present invention for controlling user activated functions duringthe showing of a selected video or other audiovisual program.

FIGS. 14(f), 14(g), 14(h) and 14(i) are continuation of the flow chartsillustrated in FIGS. 14(a) through 14(e), further illustrating theoperation of the present invention for the selection of intermission andother control functions.

FIG. 15 is a flow chart illustrating the selection and operations ofExtras displayed on the interface of the present invention.

NOTATION AND NOMENCLATURE

The detailed descriptions which follow are presented largely in terms ofinterface display images, methods, algorithms and symbolicrepresentations of operations of data bits within a computer memory.These algorithmic descriptions and representations are the means used bythose skilled in the data processing arts to most effectively convey thesubstance of their work to others skilled in the art.

An algorithm is here, and generally, conceived to be a self consistentsequence of steps leading to a desired result. These steps are thoserequiring physical manipulations of physical quantities. Usually, thoughnot necessarily, these quantities take the form of electrical ormagnetic signals capable of being stored, transferred, combined,compared, displayed and otherwise manipulated. It proves convenient attimes, principally for reasons of common usage, to refer to thesesignals as bits, values, Spaces, objects, elements, symbols, characters,Agents, images, terms, numbers or the like. It should be borne in mind,however, that all of these and similar terms are to be associated withthe appropriate physical quantities, and are merely convenient labelsapplied to these quantities.

In the present case, the operations described herein are machineoperations performed in conjunction with the human operator. Usefulmachines for performing the operations of the present invention includegeneral purpose digital computers, digitally controlled displays, orother similar devices such as settop box control systems, video ondemand servers and the like. In all cases, there should be borne in mindthe distinction between the method operations of operating a computer,multi-media display, video on demand, or other similar system, and themethod of computation itself. The present invention relates to apparatusand method steps for operating a computer and/or interactive multi-mediadisplay systems, and processing electrical or other physical signals togenerate other desired physical signals.

The present invention also relates to apparatus for performing theseoperations. This apparatus may be specially constructed for the requiredpurposes or it may comprise a general purpose computer selectivelyactivated or reconfigured by a computer program stored in the computer.The method steps presented herein are not inherently related to anyparticular computer or other apparatus. In particular, various generalpurpose machines may be used with programs in accordance with theteachings herein, or it may prove more convenient to construct morespecialized apparatus to perform the required steps.

Additionally, no particular programming language has been indicated forcarrying out the various methods described herein. This is due in partto the fact that not all languages might be mentioned are universallyavailable. Each designer of a particular computer, interactivemulti-media system, or other display apparatus will be aware of alanguage which is most suitable for his immediate purposes. In practice,it has proven useful to substantially implement the present invention ina high level language which is then compiled into machine executableobject code. Because the computers, servers, settop boxes and otherdevices which may be used in practicing the instant invention consist ofmany diverse elements, no detailed program listing has been provided. Itis considered that the operations and other procedures described hereinand illustrated in the accompanying drawings are sufficiently disclosedto enable one of ordinary skill to practice the instant invention.

DETAILED DESCRIPTION OF THE INVENTION

The following detailed description will be divided into severalsections. The first of these will describe a general system arrangementfor generating and displaying the user interface of the presentinvention. The general system description will describe one possiblevideo on demand system incorporating the teachings of the presentinvention. Subsequent sections will describe various functional aspectsof the present invention, such as the present invention's studio backlot metaphor, Poster wall and Poster Agents, "Extras" and otherinteractive features, as well as the overall structure and operation ofthe present invention's interface.

In the following description, numerous specific details are set forth toprovide a thorough understanding of the present invention. These detailsinclude functional blocks representing data processing devices, statediagrams, screen, menu and other configurations to assist the user innavigating through the interface, and to provide a thoroughunderstanding of the present invention. It will be apparent to oneskilled in the art that the present invention may be practiced withoutthese specific details. Additionally, although the user interface of thepresent invention is described with reference to a video on demandsystem, many of the features and other aspects of the present inventionhave application to a variety of other graphic user interface systemsand environments. In other instances, well known circuits and structuresare not described in detail so as not to obscure the present inventionunnecessarily.

Moreover, many of the functions and features of the present invention,such as various objects displayed in the studio back lot metaphor,Poster Agents, "Extras", icons, and selection methods, are not staticevents and are perceived by the user as having motion, color, soundand/or animation. The s present invention also includes audio featuresutilizing sounds, which compliment the visual interface and are playedin some instances simultaneously with other functions of the presentinvention, and which cannot be illustrated graphically herein, but are,nevertheless, part of the present invention. Due to the limitations of awritten specification, the reader is referred to a video tape entitled"Video on Demand User Interface" submitted by the applicants concurrentwith the filing of the continuation-in-part, Ser. No. 08/206,749, filedMar. 4, 1994 on which this patent is based.

GENERAL SYSTEM CONFIGURATION

The multimedia video on demand system of the present invention isillustrated in block diagram form in FIG. 1. As shown in FIG. 1, a videoon demand (VOD) server 20 provides video on demand programming servicesto a plurality of users over a transmission medium 22. The transmissionmedium 22 may comprise a cable television network, a telephone system, adirect broadcast satellite system, microwave system, fiber optic, and/orradio frequency (RF) system, or a variety of other electronictransmission systems known in the art.

As illustrated in FIG. 1, the transmission medium 22 is coupled to asettop box 24 which comprises an audiovisual transceiver and an infrared(IR) remote receiver 25, as well as other separately identifiableelements, as will be described more fully below. Although the receiver25 is illustrated as being an IR receiver, it will be appreciated that avariety of other communication systems may be used, including radio, lowpower cellular and the like. As illustrated, the set top box 24 iscoupled to a television 28 having a screen 29, or other audiovisualdevice such as a video tape recorder (not shown). A remote control inputdevice 30 communicates with the settop box 24 through the IR receiver25, for the selection of various functions and features of the presentinvention as described herein. The remote control 30 includes a touchsensitive display 31 which, as will be described, permits a user tooperate on the user interface of the present invention. In oneembodiment, the touch sensitive display 31 permits a user to control acursor displayed on the television screen 29 to select objects, featuresand other functions of the present invention's user interface. Otheradditional audiovisual devices may be coupled to the television 28, aswell as to the settop box 24, such as laser disc players, computers andthe like.

Referring now to FIG. 2, the VOD server 20 include s a number of othersubserver systems including a media stream server 40 for providingdigitized movies and other programming, as well as any effects such astransition animations which may be generated remotely or by the server20. Additionally, the server 20 includes a subscriber/billingtransaction server 42, to which performs necessary subscriberverification, billing, and obtains user information for video on demandas well as other programming. A settop box server 44 executes video ondemand application programming code for the system, as well as handlesthe storage, retrieval, and processing of any necessary applicationdata. As illustrated in FIG. 2, the media stream server 40, thesubscriber/billing transaction 42, and the settop box server 44, arecoupled to the transmission medium 22 through an interface (I/F) circuit46.

Referring now to FIG. 3, the settop box 24 of the present invention isshown and described in additional detail. The settop box 24 includes acentral processing unit (CPU) 50 which is coupled to an internal datatransport and flow control system, comprising a system bus or switchedmemory architecture (referred to generally by the numeral 52). A memory54 is also coupled to the internal data transport and flow controlsystem 52, as is an audiovisual (A/V) decode/decompressor 56. The memory54 stores programming code and other data required by the CPU 50 togenerate the user interface of the present invention, and execute thevarious functions described herein. As shown, the IR input circuit 25 isalso coupled to the internal data transport and flow control system 52,as is a network transfer interface circuit 60. The network transferinterface circuit 60 controls the transport in and out of video ondemand data and programming information through to the settop box 24from the VOD server 20. The transport out path 62 represents a backchannel in which user selections on the interface of the presentinvention may be communicated to the VOD server 20. Similarly,downloaded video and other data is provided over a transport in path 64to the network transfer interface 60 of the settop box 24. Additionaltuners, demodulators and the like are not shown in FIG. 3, but arecontemplated to be included in the settop box 24 to read and displaydata from the VOD server 20. These additional devices include circuitryfor providing picture in picture (PIP) windows, as well as descramblingcircuitry to descramble downloaded video data from the VOD server 20received by the settop box 24.

In operation, one of the first tasks in utilizing the system illustratedin FIG. 1, is for the subscriber to log on and be verified as anauthorized user of the video on demand/interactive television system.The specific process and/or protocol for verifying subscriberinformation is not described in the Specification, but it iscontemplated that a variety of different subscriber verificationprotocols including public/private key encryption, may be utilized tosupport the verification process. Once the subscriber is verified, theserver 20 transmits a log-in acknowledgment to the settop box 24, alongwith an authentication key which permits the subscriber to access theVOD server 20. Moreover, it is contemplated that a hierarchy will beprovided by the present invention for queries that a user may initiateonce authentication of the user is accomplished. For example, the usermay obtain category information from the VOD server 20. The categoryinformation may represent, for example, a "Top 10" listing of user videopreferences. Additionally, catalog information may be obtained from theVOD server which may represent, for example videos matching a particularcategory search initiated by the user, as well as information onspecific video selections.

As will be described, through the use of the present invention's userinterface, various functions may be selected such as start, stop, pause,intermission, and resume of a movie, and such command data is coupled bythe settop box 24 over the transport out channel out 62 to the VODserver 20. As the user navigates through the user interface of thepresent invention, various application programming code and data isprovided by the VOD server 20 to the CPU 50 of the set top box 24, fordisplay on television 28.

VIDEO ON DEMAND GRAPHIC INTERFACE

The following detailed description of the current preferred embodimentof the invention refers to, and incorporates fully, the copending Parentpatent application. Additionally, with respect to that portion of thepresent invention which relates to the user interface, the reader isreferred to the video tape entitled "Video On Demand Graphic UserInterface" (hereinafter sometimes referred to as "the videotape"),submitted concurrent with the filing of the application on which thispatent is based, to assist the reader in understanding the presentinvention as disclosed herein.

Most popular graphic user interfaces that are available, such as theXerox Star®, Apple Macintosh®, and Microsoft Windows® are based upon the"desk top metaphor". In a desk top metaphor system, the display screenis treated as a virtual desktop. Graphical symbols placed on the virtualdesktop are used to represent common objects found in an officeenvironment, such as files, file folders, and printers.

The user interface environment of the present invention utilizes a"movie studio back lot metaphor", which, as illustrated in FIG. 4presents the user with a virtual world of a movie studio back lot. Theinterface design provides an animated three dimensional view through thegates of a back lot entitled "Moviewood". As shown in FIG. 4, the backlot studio metaphor of the present invention includes a "bird's eyeview" of a center square of a studio back lot. The metaphor includes avariety of Spaces surrounding the studio back lot. For example, theSpaces shown in FIG. 4 include, an indoor sound stage 70, a Poster wall80 displaying Posters of currently available movies, a film archive 71,and a blimp 76 are displayed. As illustrated in FIG. 4 and thevideotape, various movie characters and animated objects are movingthroughout the interface of the present invention. Some of the animatedcharacters and objects are carrying sets, riding bicycles, etc.

In the presently preferred embodiment of the invention, remote 30includes a touch sensitive screen 31 to permit the subscriber to touchvarious displayed objects and characters on the graphic user interfaceshown in FIG. 4. As will be described, many of the objects andcharacters displayed in the present invention's studio back lot metaphorperform a function when touched by the user. Various Spaces, Objects,Data Objects, Buttons, Portals (including a Wayback Portal) and Agents,are provided in the user interface of the present invention asillustrated in FIG. 4, and first initially disclosed and herebyincorporated from the Parent application.

Referring now to FIG. 5, the present invention's user interface includesa Poster wall 80, which, as will be described, presents to the user aseries of movie Posters, such as for example movie Posters 82, 84, 86,88, and 90. Each of the movie Posters represents an available videoselection to the user which may, for example, comprise the "Top 10"video rentals for the week, or perhaps the newest movies which areavailable for downloading and viewing from the video on demand server20. It will be appreciated that the particular movies (herein the terms"movies" and "videos" are used interchangeably) displayed on the Posterwall 80 may represent movies in certain categories, specific userpreferred movies, or may be arranged in other desired configurations onthe Poster wall 80.

The present invention permits a user to Pan in at least two directions,and thereby navigate through the movie studio back lot interface. In oneembodiment of the present invention, panning is accomplished within theuser interface by placing a finger on the screen 31, and moving thefinger in the opposite direction the user wishes to move. The CPU 50responds to the user's finger motion by generating a "Panning active"sound, and moving the background image of the user interface on thescreen in the opposite direction of the finger's movement, therebybringing other objects into view. In the present embodiment, it iscontemplated that a user may Pan a full 360 degrees, and that in otherembodiments, the user may Pan in an up or down direction as well. Thereader is referred to the Parent application for a further descriptionof the present invention's Panning gestures for navigating through theinterface.

Assume for the sake of example that a user desires to Pan to the rightof the Poster wall 80 illustrated in FIG. 5. The user operates theremote control 30 and using the touch sensitive screen 31, moves hisfinger to the left on screen 31, thereby Panning to the right. As shownin FIG. 6, as the user Pans to the right relative to the position of theuser with respect to the screen 29, an additional Space is displayedentitled the "Critic's Cafe" 92. By touching, or otherwise selecting,the Critic's Cafe 92 using the remote control 30, the interior of theCritic's Cafe is displayed (not shown) along with other objects whichmay be selected. Although the present invention is described withreference to a remote control 30 for the selection of objects andnavigation through the present invention's user interface, it will beappreciated by one skilled in the art that a variety of other selectionmethods and devices may be utilized to accomplish the same result. Forexample, it is contemplated that the remote control 30 (see FIG. 1) mayutilize a joystick instead of the screen 31 for navigation andselection.

Referring now to FIG. 7 in conjunction with the flowcharts of FIGS.14(a) through 14(c), the present invention's method and apparatus forthe selection of video on demand movies and other programming serviceswill be disclosed. As previously described, the Poster wall 80 displaysa pre-defined number of "Posters" of available movies (or otherprograms) which may be selected and viewed by the user. When a usertouches a Poster, for example Poster 90, on the Poster wall 80, the CPU50 senses the user selection and generates an animation which displaysthe Poster coming off of the wall and appearing in the foreground. Thepurpose of the Poster moving to the foreground is to permit users toobtain more information about the video, before deciding whether or notto rent or otherwise order the video from the VOD server 20.

It is anticipated that a regular user of the present invention maydesire to select movies without triggering the Poster opening animation,thereby saving time. Thus, in accordance with the presently preferredembodiment of the invention, after a user interacts with the Poster wall80 more than three times, the longer animation sequence is no longeractivated by the CPU 50 when a Poster is touched, but rather, a shorteranimation is activated, and the Poster simply leaps into the foreground.

As provided in the flow charts of FIG. 14, when a Poster on the Posterwall 80 is touched, an animation is triggered. The Poster animationsequence of the present invention makes the Poster have the appearanceof jumping off the Poster wall, moving to the foreground and unfurlingas illustrated in FIG. 8. As shown in FIG. 8, an unfurled Poster 93appears in a cartoon-like animated form having hands 94, a Poster body96, and a Poster information area 98. Poster information area 98 isprovided for the display of information related to a particular movie orother programming available for selection by the user. In the presentembodiment, information presented within the Poster information area 98appears to the user as a movie poster advertisement, similar to thatprovided in a newspaper, magazine or at a movie theater. As set forth inthe flow chart in FIGS. 14(a)-14(i), if subsequent to the display ofPoster 93 the user touches another area of the user interface, such asthe background, Poster 93 appears to snap back onto the Poster wall 80,with the user continuing to view the Poster wall as shown in FIG. 7.

Similarly, if after the selection of a Poster 93 and its display in theforeground, a user takes no further action by either touching Poster 93or the background, the Poster, in an animated form, appears to hold aclock 100 and begins tapping its "foot" 102 as illustrated in FIG. 9 andprovided in flow chart form in FIGS. 14(a)-14(e). The foot tappinganimation is intended to communicate to the user that the Poster 93 wasactivated, and that some action is necessary in order to proceed withthe selection of the desired movie or other programming. In the presentembodiment, the animated foot tapping of the Poster 93 continues to bedisplayed until either the Poster 93, or the background, is touched. Itwill be appreciated that other possible animations may be used by Poster93 to remind the user that some action is necessary to proceed with theselection of a movie.

In the event a user touches the Poster 93 (utilizing, for example, theremote control 30) the present invention then displays a video viewingspace, as will be described with reference to the flow chart of FIGS.14(b)-14(i).

Upon the selection of the Poster 93, the CPU 50, executing programmingstored in the memory 54, displays a video viewing space 120diagrammatically illustrated in FIG. 10. The video viewing spacerepresents a Space for the control of the television 28, watchingtelevision programming, movies, movie previews, and the like. Overlayingthe video displayed within the video viewing space 120 are a variety ofSpace control functions, which, after a pre-determined amount of timefade from view. In the present embodiment, touching the screen 31, ofthe remote control 30, results in the CPU 50 re-displaying the controls.The controls represent objects which comprise individual graphicalfunction icons, that are rendered on the user interface of the presentinvention by the CPU 50. As provided in the Parent application on whichthis application is based, each control function is an object-orientedprogramming type of object containing data methods which can be invokedto act on the data. For example, a cash register button function 130 isdisplayed to permit a user to "purchase" the selected movie. Touching,or otherwise activating, the cash register function 130 results in a"ring-up sale" animation, the termination of any currently displayedpreview of the selected movie, and the initiation of the viewing of thefeature movie selected. Upon final selection of the movie by activatingthe cash register function 130, the server 20 downloads the selectedvideo to the settop box 24 for display on the television 28.

As illustrated in FIG. 10, additional controls displayed on theinterface of the present invention include a mute button functioncontrol 132 for muting the sound of the currently displayed programming.Similarly, a preview notice 134 is provided to indicate that thecurrently displayed programming constitutes a preview rather than afeature presentation.

A volume control 136 permits the user to adjust the audio volumeutilizing the remote control 30. An up-down channel control 140 permitsthe user to change channels of the television 28 when a user is viewingtelevision programming.

An exit control 142 is similar to the Wayback portal disclosed in theParent application. As shown, the exit control 142 consists of an exitsign with a small rectangular frame 144 which encloses a snapshot of theprevious Space from which the user has traveled from within the studioback lot metaphor. For example, if a user has moved from the Poster wall80 to the video viewing space 120, the rectangular frame 144 willdisplay Poster wall 80. By touching, or otherwise activating the exitfunction 142, the user may move through this exit Wayback portal to theposition facing the Poster wall 80, and exiting the video viewing space120. In the presently preferred embodiment, the selection of exit 142cancels the currently-viewed movie, however, it is contemplated that auser may, as in the case of a real life theater, exit the movie toperform some function (for example answering the phone), and then returnto the movie still in progress. Reference is made to the flow charts ofFIGS. 14(a)-14(i) for a detailed description of the operation andfunction of the controls illustrated in FIG. 10, and the resultingoperations by the CPU 50 of the settop box 24.

Referring now to FIG. 11, once the user has selected a video on demandmovie from the VOD server 20, CPU 50 downloads the selected videoprogramming over the medium 22 to the settop box 24 for viewing on thetelevision 28, as described above. The graphic user interface of thepresent invention is modified as illustrated in FIG. 11, and describedin the flow charts of FIGS. 14(a)-14(i). More particularly, the cashregister 130 is replaced with a five minute intermission control button150. The selection of the intermission control button 150 by the userresults in the currently viewed feature presentation being paused and anintermission being interjected.

As illustrated in FIG. 12, if a user during the viewing of a movieselects a channel using the up-down channel control 140, theintermission control button 150 is replaced by a return to movie buttonfunction 160 as shown in FIG. 12. The user may activate the return tomovie function 160, and the CPU 50 of the settop box 24 resumes thedisplay of the selected movie or other programming. Also, as illustratedin FIG. 12, an intermission countdown clock 162 is displayed in thevideo viewing space 120 and identifies in a countdown fashion how muchtime is left in the current intermission cycle. If a user activates thechannel change function 140 during an intermission cycle, countdownclock 162 remains visible as well as the return to movie controlfunction 160. Thus, during an intermission a user may view programs froma cable television or other source, and select the channels using thechannel change function 140.

It will be appreciated by one skilled in the art that the variousobjects and control functions illustrated in FIGS. 10, 11 and 12 areadaptable to other graphic user interface designs, and may beinterchanged, substituted and supplemented dependent upon the particularuser interface application. The reader is referred to the flowchartsillustrated in FIG. 14(a)-14(i) for a detailed operational descriptionof the present invention intermission and return to movie controlfunctions as described above.

Referring now to FIGS. 13 and 15, the present invention's graphic userinterface includes "Extras" which operate asynchronously in the studioback lot metaphor and notify the user of events, advertisements, and/oravailable video on demand movies and the like. Extras are manifestationsof the Agent as disclosed in the Parent application. As provided in theParent, an Agent is an anthropomorphic character which aids the user innavigating around the user interface, and in dealing with events thatoccur in the "world" created by the user interface. In the studio backlot metaphor of the present invention, Extras are manifestations ofadvertising which wander randomly throughout the back lot metaphor.Extras can be ignored by the user, or alternatively, may be activated byselecting the Extra displayed on screen 29 (utilizing the remote control30). One example of an Extra is shown in FIG. 13. An Extra in the formof a "Cupid" 170 changes form if selected by the user utilizing theremote control 30, and performs a short animation prior to displaying aPoster for an available video not otherwise shown on the Poster wall 80,or displaying an advertisement for a Poster on the Poster wall 80. Oncethe Extra introduced a Poster, the Poster behaves as do other Postersdisplayed upon the Poster wall 80. It is contemplated that Extras canalso "advertise" other Spaces in the studio back lot metaphor. Forexample, an Extra may advertise the "Critic's Cafe", "Archive" or otherSpace within the back lot world. If a user activates that Extra, theuser is then transported to the Space which was advertised by the Extra.Extras may also advertise related services available to the user,including for example, pizza delivery services, local/nationalmerchants, or news, weather or sports programming.

Although Extra 170 of FIG. 13 is shown as having the form of a Cupid, itwill be appreciated that the Extra can take on any shape. For example,as shown in the videotape entitled "VOD Graphical User Interface",Extras take the form of bats, spaceships, cupids, and the like. Ineffect, an Extra notifies the user of asynchronous events, and like theAgent in the Parent application, may move in a semi-random order fromSpace to Space within the back lot metaphor.

Referring now to FIG. 15, a flow chart illustrating the operation andsequence of steps executed by the CPU 50 in the generation and displayof Extras is shown. As illustrated in FIG. 15, if an Extra is in view onthe television screen 29, it will be displayed on the back lot until itis touched or otherwise activated by a user. Upon activation, the CPU 50modifies the visual appearance of the Extra to that of a Poster throughan animation series. The Poster is then displayed in the foreground ofthe area of the studio back lot metaphor which the user is currentlyviewing. If a user does not wish to select the video advertised by theExtra, he may select other areas outside of the Poster using the remotecontrol device 30. The CPU 50 then generates a Poster "leaving" screenanimation sequence and the user is free to continue to navigatethroughout the studio back lot metaphor.

In the event that the user desires to view the video advertised by thePoster introduced by the Extra, he may touch the Poster and CPU 50executes the steps illustrated in FIGS. 14(a)-14(i), as previouslydescribed with reference to the Poster wall 80. Similarly, if the Extraadvertises other parts of the back lot metaphor, the activation of theExtra will result in the user being transported to that area on the backlot.

SUMMARY

The present invention as described provides methods and apparatus for aunique graphical user interface for video on demand, interactivetelevision, and other audiovisual programs and services. The presentinvention's functions and features provide a user interface whichassists subscribers to find and view programs and movies of interest,access related information, control a variety of audiovisual functionsand devices, and order video on demand services from their homes andoffices.

The teachings of the present invention may be applied to numerous otherdisplay devices and input mechanisms. For example, the present inventionmay be practiced using what is known as "virtual reality" input devices,such as but not limited to, a data input glove, body glove input device,etc. In addition, the present invention may be utilized with eye goggledisplays which are worn by a user and coupled to the computer displaysystem via fiber optics, wires and the like. When the present inventionis utilized in conjunction with a virtual reality system, the userinterface of the present invention would be viewed by a user throughinput goggles as being suspended in space. Interaction with theinterface by the user may be done using an input glove or other virtualreality device worn by the user. Accordingly, it will be appreciatedthat the user interface of the present invention is not limited toconventional input or display devices. The reader is referred to thefollowing references for a further description of existing and proposedvirtual reality systems. Computerized Reality Comes of Age, NASA TechBriefs, page 10, August 1990 (Vol. 14, number 8); Iwata, ArtificialReality with Force-Feedback; Development of Desktop Virtual Space withCompact Master Manipulator, ACM SIGGRAPH, august 1990 (Vol. 24, number4); Nash, Our Man in Cyberspace Checks out Virtual Reality,Computerworld, Oct. 15, 1990; Daviss, Grand Illusions, Discover, June1990.

While the present invention has been described with reference to FIGS. 1through 15, it will be appreciated that the Figures are for illustrationonly, and do not limit the spirit and scope of the invention. Bynecessity, the description provided in the Specification describes, forexample, screen images having certain attributes and features, however,it will be appreciated that the invention is not limited by the specificexamples provided herein.

We claim:
 1. A display system for the display of audiovisualprogramming, comprising:a receiver for receiving said audiovisualprogramming from an audiovisual program source; a user interface for thedisplay of said audiovisual programming on a display, said userinterface incorporating a metaphor having a plurality of Spaces, whereinat least one of said Spaces displays representations of availableaudiovisual programming for display on said display, and further whereinsaid Spaces are arranged in said user interface such that each of saidSpaces is disposed relative to one another within said metaphor; anelement to permit a user to interact with said Spaces using a user inputdevice, said interaction allowing said user to select a desiredaudiovisual program, such that said selection results in said selectedaudiovisual program being displayed on said display; an element enablingsaid user to navigate between said Spaces in said metaphor; wherein uponsaid selection of one of said representations by said user using saidinput device, said user interface displays a video viewing space on saiddisplay.
 2. The display system as defined by claim 1 wherein saidaudiovisual program corresponding to said selected representation isdisplayed for viewing by said user in said video viewing space.
 3. Thedisplay system as defined by claim 2 wherein a preview of said selectedaudiovisual program is displayed prior to said selected audiovisualprogram, said selected audiovisual program being displayed upon afurther selection of said selected representation by said user.
 4. Thedisplay system as defined by claim 3 wherein said video viewing spaceincludes a plurality of user selectable controls displayed on saiddisplay.
 5. The display system as defined by claim 1 wherein said atleast one of said Spaces presenting said user with a plurality of saidrepresentations of available programming is in the form of a wall, andeach of said plurality of representations is in the form of a Posterdisposed on said wall.
 6. The display system as defined by claim 5wherein upon said user selecting one of said Posters disposed on saidwall, said Poster is displayed in an animated form in the foreground ofsaid metaphor on said display.
 7. The display system as defined by claim6 wherein said Poster displayed in animated form on said display furtherdisplays additional information relating to the audiovisualrepresentation to which said Poster relates.
 8. The display system asdefined by claim 7 wherein an Agent, upon selection by a user, isdisplayed on said interface as changing into the form of a Poster in theforeground of said metaphor on said display.
 9. The display system asdefined by claim 8 wherein said Agent which has changed into the form ofsaid Poster displayed in animated form on said display, further displaysadditional information relating to the audiovisual representation towhich said Poster relates.
 10. The display system as defined by claim 4wherein said controls displayed on said display in said video viewingspace includes a volume adjustment control selectable by said user. 11.The display system as defined by claim 10 wherein said controlsdisplayed on said display in said video viewing space includes a mutecontrol adjustment selectable by said user.
 12. The display system asdefined by claim 4 wherein said controls displayed on said display insaid video viewing space includes a Wayback exit control selectable bysaid user, the selection of said exit control resulting in said userinterface automatically navigating said user to the last Space fromwhich said user was located in said metaphor prior to said user enteringsaid video viewing space.
 13. The display system as defined by claim 12wherein said audiovisual source comprises a video server for providing aplurality of user selectable audiovisual programs to said receiver. 14.The display system as defined by claim 13 wherein said audiovisualsource further provides television audiovisual programming to saidreceiver.
 15. The display system as defined by claim 14 wherein saidcontrols displayed in said video viewing space includes a video purchasecontrol selectable by said user for purchasing an audiovisual programselected by said user.
 16. The display system as defined by claim 15wherein said video purchase control may be activated by said user duringthe display of a preview of said selected audiovisual program in saidvideo viewing space.
 17. In a display system for the display ofaudiovisual programming, a method for the display and selection of saidprogramming comprising the steps of:providing an element for receivingsaid audiovisual programming from an audiovisual program source;providing a user interface for the display of said audiovisualprogramming on a display, said user interface incorporating a metaphorhaving a plurality of Spaces, wherein at least one of said Spacesdisplays representations of available audiovisual programming fordisplay on said display, and further wherein said Spaces are arranged insaid user interface such that each of said Spaces is disposed relativeto one another within said metaphor; providing an element forinteracting with said Spaces using a user input device, said interactionpermitting a user to select a desired audiovisual program, such thatsaid selection results in said selected audiovisual program beingdisplayed on said display; providing an element for performing the stepof enabling said user to navigate between said Spaces in said metaphor;wherein upon said selection of one of said representations by said userusing said input device, said user interface displays a video viewingspace on said display.
 18. The method as defined by claim 17 whereinsaid audiovisual program corresponding to said selected representationis displayed for viewing by said user in said video viewing space. 19.The method as defined by claim 18 further including the step ofdisplaying in said video viewing space a plurality of user selectablecontrols displayed on said display.
 20. The method as defined by claim18 further including the step of displaying a preview of said selectedaudiovisual program prior to said selected audiovisual program, saidselected audiovisual program being displayed upon a further selection ofsaid selected representation by said user.
 21. The method as defined byclaim 18 wherein said at least one of said Spaces presenting said userwith a plurality of said representations of available programming is inthe form of a wall, and each of said plurality of representations is inthe form of a Poster disposed on said wall.
 22. The method as defined byclaim 21 wherein upon said user selecting one of said Posters disposedon said wall, said poster is displayed in an animated form in theforeground of said metaphor on said display.
 23. The method as definedby claim 22 wherein said poster displayed in animated form on saiddisplay further displays additional information relating to theaudiovisual representation to which said Poster relates.
 24. The methodas defined by claim 23 wherein an Agent, upon selection by a user, isdisplayed on said interface as changing into the form of a Poster in theforeground of said metaphor on said display.
 25. The method as definedby claim 24 wherein said Agent which has changed into the form of saidPoster displayed in animated form on said display, further displaysadditional information relating to the audiovisual representation towhich said Poster relates.
 26. The method as defined by claim 19 furtherincluding the step of displaying said controls displayed on said displayin said video viewing space including a Wayback exit control selectableby said user, the selection of said Wayback exit control resulting insaid user interface automatically navigating said user to the last Spacefrom which said user was located in said metaphor prior to said userentering said video viewing space.
 27. The method as defined by claim 26wherein said audiovisual source comprises a video server for providing aplurality of user selectable audiovisual programs to said receiver. 28.The method as defined by claim 27 further including the step ofdisplaying a video purchase control selectable by said user forpurchasing an audiovisual program selected by said user as one of saidcontrols displayed in said video viewing space.
 29. The method asdefined by claim 28 wherein said video purchase control may be activatedby said user during the display of a preview of said selectedaudiovisual program in said video viewing space.
 30. A video displaysystem for the display of video programming, comprising:a settop boxincluding a circuit for receiving said video programming from a videoserver; a user interface for the display of said video programming on adisplay, said user interface incorporating a metaphor having a pluralityof Spaces, wherein at least one of said Spaces displays representationsof available audiovisual programming for display on said display, andfurther wherein said Spaces are arranged in said user interface suchthat each of said Spaces is disposed relative to one another within saidmetaphor; a user interacting with said Spaces using a user input device,said interaction permitting said user to select a desired video program,such that said selection results in said selected video program beingdisplayed on said display; an element enabling said user to navigatebetween said Spaces in said metaphor; wherein said at least one of saidSpaces presenting said user with a plurality of said representations ofavailable programming is in the form of a wall, and each of saidplurality of representations is in the form of a Poster disposed on saidwall.
 31. The display system as defined by claim 30 wherein upon saiduser selecting one of said Posters disposed on said wall, said Poster isdisplayed in an animated form in the foreground of said metaphor on saiddisplay.
 32. The display system as defined by claim 31 wherein saidPoster displayed in animated form on said display further displaysadditional information relating to the audiovisual representation towhich said Poster relates.
 33. The display system as defined by claim 32wherein an Extra, upon selection by a user, is displayed on saidinterface as changing into the form of a Poster in the foreground ofsaid metaphor on said display.
 34. The display system as defined byclaim 33 wherein said Extra which has changed into the form of saidPoster displayed in animated form on said display, further displaysadditional information relating to the audiovisual representation whichsaid Poster relates.